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Abstract 

One  use  of  spectral  analysis  of  time  series  is  to 
determine  if  two  different  time  series  are  realizations  from 
the  same  process.  This  thesis  develops  the  theory  behind 
Krishnaiah  and  Schuurmann’s  theoretical  work  reported  in 
their  report  Approximations  to  the  Distributions  of  the 
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I.  Introduction 

The  Air  Force  Testing  and  Evaluation  Center  (AFTEC)  at 
Kirtla,  Air  Force  Base,  New  Mexico,  has  had  a requirement 
in  the  past  to  compare  two  different  time  series  to  determine 
if  it  can  be  assumed  that  they  are  realizations  from  the  same 
process.  They  also  foresee  having  the  same  requirement  in 
future  tests  where  they  will  be  comparing  radar  tracking 
errors.  One  time  series  will  come  from  a simulation  model, 
the  Air  Force  Electronic  Warfare  Environmental  Simulation 
(AF-EWES)  model  developed  by  General  Dynamics,  Fort  Worth, 
Texas.  The  second  time  series  will  be  determined  from 
field  tests. 

Each  of  the  error  series  is  a three  variable,  vector 
time  series.  Each  variable  represents  the  error  in  a spe- 
cific direction  of  a three-dimensional  reference  surface. 

That  is,  one  variable  represents  the  error  in  the  x-direction, 
another  variable  represents  the  error  in  the  y-direction,  and 
the  third  variable  represents  the  error  in  the  z-direction. 

This  technique  will  be  useful  in  validating  the  results 
of  a simulation  model  with  real-world  data.  While  one  can 
not  prove  that  a model  is  correct,  one  can  collect  evidence 
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(data)  that  may  support  the  model  or  show  that  the  model  does 
not  fit  the  data. 


L 


This  thesis  will  describe  one  use  of  spectral  analysis 
to  test  two  hypotheses.  The  procedure  used  was  developed  by 
P.  R.  Kirishnaiah  and  F.  J.  Shuurmann.  The  null  hypothesis 
is  that  the  two  time  series  being  compared  can  be  considered 
realizations  from  the  same  process. 

The  organization  of  the  thesis  is  as  follows.  Chapter  II 
reviews  the  notation,  theory  and  procedure  used  in  comparing 
the  time  series.  Chapter  III  contains  the  results  of 
Monte  Carlo  simulation  while  conclusions  and  recommendations 
are  in  Chapter  IV. 


r 


hi 


elements  a^  we  may  indicate  the  matirx  as  Lajic]* 

A - La-vl»  where  j indicates  the  row  position  of  a and  k 
the  column.  The  expected  value  of  X(t)  is  denoted 


ECX^t)) 

E(X2(t)) 

E(Xr(t)) 


E(X(t)) 


(2) 


We  will  estimate  the  expected  value  of  X(t)  using  the 
arithmetic  mean, 


_ 1 
X » = I 


t=l 


X(t), 


(3) 


where  T is  the  number  of  data  points  in  each  scalar  time 
series. 

Denoting  the  transpose  of  X(t)  as  X'(t)  we  define  the 
covariance  matrix  of  X(t)  and  X(t  h)  as 

T(h)  =*  E(X( t)  X‘(t  + h))  * [Ytj(h)]  (4) 

where  Yi:j(k)  * E(Xt(t)  Xj(t  + h))  . P (h)  must  be  abso- 
lutely summable,  that  is, 

00 

Z I Yj_ j(k)  I < 00  fori,  j*l,...,r  (5) 
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f 


(6) 


The  sample  covariance  matrix  will  be  denoted  as  C(h) 
and  defined  to  be 


T 

C(h)  = E((X(t)  - X(t))  (X’(t  + h)  - X(t))) 

1 t=l 


where  T is  the  number  of  data  points  for  each  vector  and 
X is  the  estimated  mean  of  X(t),  Eq  (3).  Fuller  states  this 
estimator  has  the  smaller  mean  error  of  two  biased  estimators 
he  proposed  (Ref  4j236).  He  recommends  using  this  estimator 
because  it  will  ensure  that  the  estimated  covariance  function 
is  positive  definite. 

To  talk  about  the  correlation  matrix  for  a vector  time 
series  we  need  to  define  it  for  a scalar  time  series.  Let 
0(h)  be  the  autocorrelation  of  a stationary  time  series,  then 


To  extend  to  a vector  time  series  we  have 


-1 

£00  - d0 


foofio 


-1 


(7) 


(8) 


where  Dq  is  a diagonal  matrix  with  the  square  root  of  the 
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variances  of  Xr(t)  as  the  diagonal  elements.  Dq  **  {diag 
C Yu (0)  a ^22^) * • • • i Y^CO))*  We  will  write  the  ij^  element 
of  P(h)  as  p^jCh)  and  call  it  the  cross  correlation  between 
X^t)  and  Xj(t). 


Theory 


The  theory  used  in  this  thesis  will  draw  on  termi- 
nology and  notations  defined  in  the  previous  section.  As 
other  terms  are  needed  they  will  be  defined.  Proofs  will 
not  be  givens  the  reader  may  find  the  proof  or  a discussion 
of  the  proof  in  the  references.  The  procedure  we  will  be 
using  involves  the  calculation  of  a Fourier  transform  on  the 
covariance  matrix.  Fuller  uses  two  theorems  to  state  a spe- 
cial case  of  the  Fourier  integral  theorem  (Ref  4 i 107- 109  and 
110-111).  The  theorems  follow  another  theorem  he  presents 
that  we  need  (Ref  4il06). 

Theorem  1 i 

Let  f(x)  be  an  absolutely  integrable  function  of  period 
2it.  Then, 

(i)  At  a point  of  continuity  where  f(x)  has  a 
right  derivative  and  a left  derivative, 

a0  80 

f ( x)  - -y  + E (a^  cos  kx  + sin  1^) ; 
k3l 

(ii)  At  every  point  of  discontinuity  where  f(x) 
has  a right  and  a left  derivative, 


a0 

T 


+ 


E (a.  cos  k. 
k»l  K 


+ bk  sin  kx) 


f Cx*)  + f(x~) 


In  this  theorem  the  Fourier  coefficients, 
defined  as  follows  (Ref  4 i 95 -96). 


and  b^  are 


Let  L[A]  =»  largest  Integer  s ^ then  for  ^ 

m » 0,  1,  2,  ...  f L[n]  we  have 
N-l 

2 £ f(t)  cos  t 

am ^ H m - 1.2 L[N-l] 


N-l 

£ f(t)  cos  (a-/  t 

t°Q 

N 


m ■ 0 and 


N-l 

2 £ f(t)  sinLy  t 

t=0 

N 


“ " I 


If  N Is  even 


for  m = 1.2,....  L[N-1] 


Theorem  2i 


Let  f(x)  be  a continuous  periodic  function  of  period 
2tt  with  derivative  f’(x)  that  is  square  integrable. 
Then  the  Fourier  series  of  f(x)  coverges  to  f(x) 
absolutely  and  uniformly. 


Theorem  3i 


Let  the  correlation  function  p(h)  of  a stationary  time 
series  be  absolutely  summable.  Then  there  exists  a 
continuous  function  f(U)  such  that» 


(i)  p(h)  ■ S f(U)  cosUh  dU 

-TT 


(ii)  f(U)  > o 


rr 


(ill)  J*  f(^/)  dU  - 1 

-rr 

(iv)  f (LJ)  is  an  even  function. 

Theorem  2 states  that  a sequence  of  Fourier  coefficients  for 
a continuous  periodic  function  with  a derivative  that  is 
square  integrable  can  be  used  to  build  a sequence  of  functions 
that  coverges  to  the  original  function.  The  argument  that 
follows  is  from  Fuller  (Ref  4i 115-116).  The  result  of 
Theorem  2 can  be  restated  compactly  by  substituting  the 
definitions  of  a^  and  b^  into  the  statement  of  Theorem  1 and 
getting 


fix) 


4-  E e"lkx  / f iu)  eik^  d U 

* k»-»  -it 


(9) 


The  reciprocal  relationships  are  well  defined  and  we  can 
write  Eq  (9)  in  terms  of  Theorem  3. 


oOO  - 4=  S eikL/  E 0(h)  e~lhU  du J (10) 

-TT  h--« 

We  call  p(k)  and  f(x)  a transform  pair. 

We  will  call  the  transform  with  the  constant  and  the 
negative  exponential  the  Fourier  transform  or  spectral 
density.  The  f (U)  mentioned  in  Theorem  3 defined  by 

fiU)  m ^ Z D(h)  e'iL/h  (11) 

h“-«* 
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Is  the  Fourier  transform  of  p(h).  We  can  also  say  that  it 
is  the  spectral  density  associated  with  p(h).  The  second 
transform  in  Eq  (10)  consists  of  the  constant  and  the 
positive  exponential  and  is  called  the  inverse  transform  or 
characteristic  function.  We  can  write 

p(h)  - J f(L,)  eihU  6U  (12) 

-TT 

We  have  seen  that  if  we  have  a correlation  function 
for  a time  series  we  can  get  a spectral  density,  and  that 
if  we  have  a spectral  density  we  can  find  a correlation 
function  that  is  the  inverse  transform  of  the  spectral 
density.  We  can  extend  this  discussion  to  the  covariance 
function  since  the  covariance  function  is  the  correlation 
function  times  the  variance  of  the  process.  We  will,  again, 
follow  Fuller's  discussion  (Ref  4il26-127).  First,  p(h)  can 
be  expressed  in  a Lebesgue-Stiel jes  integral  form  as 

p(h)  = J elU/hdG(L0  (13) 

-TT 

where  G(&)  is  a statistical  distribution  function.  If  we 
multiply  p(h)  by  the  variance  of  the  process  we  can  get  the 
covariance  function 

Y(h)  = J eiL/h  dF(U)  (14) 

-TT 


£ 


where  dF(U)  * y(0)  dG(U)  . Both  G(U)  and  F (U)  have 
been  called  the  spectral  distribution  function. 


i 


ti 


* 
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Now,  assume  y(h)  i-3  absolutely  summable,  as  in  Eq  (5). 
By  Theorem  3 we  can  define  f (LJ)  by 

f(U)  “ £ Y(h)  e 

h=-<® 

i 00 

® 7 J Y(h)  cosCJh  (15) 

L h— » 


which  is  a continuous  nonnegative  even  function  and  the 
inverse  transformation  is 

Y(h)  - f f(U)  eiUh  dU  (16) 

-rr 


and  when  we  compare  Eqs  (16)  and  (14)  we  can  say  dF(U)  ■ 
f (LJ)  d LJ  and  f(U)  is  the  spectral  density  function 
defined  in  Eq  (11). 

The  discussion  so  far  has  been  in  terms  of  scalar  time 
series.  The  spectral  representations  of  vector  time  series 
follows  in  a straightforward  manner.  Again  our  discussion 
is  from  Fuller  (Ref  4 i 153-154). 

Recall  that  Eq  (4)  stated  that 

JT  00  - [y jm  (h)] 

and  assume  that  [Yjm  (h)]  is  absolutely  summable  as  defined 
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* 


in  Eq  (5).  Then, 


i 


i 

i 


| . I 

I I 

i 


ll7) 

is  a continuous  periodic  function  of  U called  the  cross- 
spectral  function  of  Xj(t)  and  Xm(t),  for  -«  < U < «>  and 
J , n * 1 1 , • • , r. 

If  we  let  F(L/)  be  the  spectral  density  matrix  with  a 
typical  element  represented  by  fjm(Ly),  we  can  use  the  fol- 
lowing  matrix  representation 

.T(h)  « J etUh &U)  4U  (18) 

-rr 

and 

F(Ly)  *4-1  e_1^h  £(h)  (19) 

2tt  h— «o 

Let  us  look  at  some  properties  of  Eq  (17)  following 
Brillinger’s  discussion  (Ref  2i23-25).  The  requirement  that 
||Yjm(h)]  is  absolutely  summable  says  that  fjm(Ly)  i s bounded 
and  uniformly  continuous.  If  the  components  of  X(t)  are  real- 
valued then 

- f*„(-L/>  - (20) 

where  f*m  indicates  the  complex  conjugate  of  f We  can 

also  see  that  f . (Ly)  has  a period  of  2n  with  respect  to  U 
jm 
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and  it  is  positive  semldefinite  if 

w*  B w > 0. 

Brillinger  calls  positive  seraidefinite  non-negative  definite. 
We  will  use  Fuller’s  version  of  the  following  theorem 

(Ref  4il55)  because  Fuller  has  a proof,  even  though  Brillin- 

I 

ger  also  states  it  (Ref  2i24). 
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Theorem  4i 


For  a stationary  time  series  of  dimension  r satisfying 

lYJm(h)l  < " 

for  j,  m = 1,  2,  . . . , r,  the  matrix  F(Ly)  is  a 

positive  semidefinite  Hermitian  matrix  for  all  U in 

[-TT,  Tr], 

Theorem  4 tells  us  that  F*(U)  = F’( U).  Combining 
Theorem  4 and  the  properties  of  symmetry  and  periodicity 
that  we  have  discussed  above  indicate  that  the  domain  of 
may  be  restricted  to  the  interval  [0,  *]. 

Now  that  we  have  looked  at  the  spectral  density  matrix 
and  its  properties  we  need  to  look  at  how  to  estimate  it  with 
the  realization  of  a time  series  we  are  working  with.  We 
will  estimate  fjm  with  a second-order  pericdogram,  1^, 
defined  to  be  (Ref  2il20(  235) 


T 2 

IjjU)  - ( 2ttT ) ” 1 Z i |Xj(t)  eUt|  (21) 

I ■ 

where  T is  the  number  of  data  points  in  Xj(t).  Expanding 


to  the  case  of  a vector  time  series  we  have 


for  X t 0,  +2tt, 
gram  as  a matrix 


We  can  also  represent  the  periodo- 


ia)  - CiJmu)]  (23) 

or 

X ^ 

I(X)  - (2TTT)"1  £ X(t)  e‘Uc)  [e  X(t)  e‘Uc  (24) 

t=l  / lt«l  ' 

for  j,  i * 1,  . . . , r and  -<»  < X < » . it  can  be  seen  that 
I(X)  has  the  same  properties  of  symmetry  and  periodicity  as 
F(£*y).  The  distribution  of  I is  an  important  item  to  con- 
sider i it  is  given  in  the  next  theorem  by  Brillinger 
(Ref  2 i 238). 

Theorem  5 « 

Let  X(t),  t **  0,  +1,  . . . be  an  r vector-valued  series 
satisfying  Eq  (5).  Let  1(0  be  defined  as  in  Eq  (24). 
Let  Sj(T)  be  an  integer  with  Xj(T)  “ 2 Sj(T)/T  tending 

to  Xj  as  T — oo  for  j = 1 J.  Suppose 

2 Xj(T),  Xj(T)  + Xk(T)  £ 0(mod  2it)  for  1 s j < k s J 
and  T sufficiently  large.  Then  I(Xj(T)),  j » 1,  ...»  J 
are  asymptotically  independent  w£  (1,  F(Xj)), 
j * 1*  ...»  J.  Also  if  X “ ±rr,  +3^,  . . . , I(X) 
is  asymptotically  Wr  (1,  F(x))  independently  of  the 
previous  variates. 

As  a note,  the  notation  (df,  F(L/))  indicates  a central 
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complex  Wlshart  distribution  of  dimension  r and  df  degrees 
of  freedom  with  a covariance  matrix  of  F(Ly).  The  Wr  without 
the  superscript  C indicates  a Wishart  distribution  of  dimen- 
sion r.  Note  that  is  a special  case  ofjj^. 

An  important  outcome  of  this  theorem  is  that^Wien 
Xj  ■ X,  we  have  a source  for  J asymptotically  independent 
estimates  of  F(X).  The  theorem  also  points  out  a limitation 
of  using  Eq  (24)  as  estimate.  With  one  degree  of  freedom, 
the  Wishart  distribution  is  well  spread  out  about  F(X). 
Brillinger  (Ref  2i240)  arrives  at  the  conclusion  "that  second- 
order  periodograms  were  not  reasonable  estimates  of  second 
order  spectra."  The  main  reason  is  that  I is  not  consistent, 
that  is,  the  estimate  does  not  improve  as  T gets  larger.  We 
can  increase  the  degrees  of  freedom  of  the  complex  Wishart 
distribution  by  averaging  a certain  number  of  asymptotically 
independent  variates  together.  The  higher  degrees  of  freedom 
would  lessen  the  spread  of  the  distribution  around  F(X). 

This  idea  leads  us  to  the  smoothed  periodogram  which  we  will 
discuss  next. 

Krishnaiah  (Ref  6»20)  recommends  the  following  estimate 
for  F(ij) 

F(U)  - [fJk(U)]  (25) 


fjk(L/) 


(26) 
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with 


X = U + ^ (27) 

Ijk(X)  = ZjCX)  Z*(X)  (23) 

and 

T 

Z . (X)  = 1/(2ttT)^  Z x.(t)  e’tUt  (29) 

J t=l  J 

where  W are  weights  wliose  sum  equals  one  and  T is  the 
number  of  data  points  in  the  scalar  time  series  Xj(t).  In 
this  representation  I..  (X)  is  a second  order  periodogram  and 

A 

fjk(  U)  is  the  average  of  (2m  + 1)  periodograms  and  is  called 
the  smoothed  periodogram. 

Brillinger  (Ref  2*242-3)  recommends  the  following  esti- 
mates with  given  as  thus 


IT(CJ) 


(T  ' \ I T 

Z X(t)  Z X(t)  e"lL;t 


t-1 


t=l 


(30) 


Z Z 


(31) 


which  is  the  same  as  Krishnaiah.  However,  Brillinger  gives 

A 

three  estimates  for  F(U)  depending  on  the  value  of  (&). 


F(U) 


(2m  + l)"1  Z 


a«-m 


(32) 


if  Lj  ^ O(modrr) 
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(33) 


I 

d i 


\ 


I 


L 


i(u) 


m'1  2 Realjl  ju 


+ 


2rra  ■ 

T I. 


if  U =0,  ±2tr or  if 

^ = ±^1  ±3rr,  . . . and  T is  even 


A _ 1 ® 

F(Ly)  = m 1 2 Real 
a=l 


rr 


U - f + 


2rra 

T 


(34) 


if  Ly  = +rr,  +3tt,  . . . and  T is  odd 


where  2tts(T)/T  — -*  Lj  as  I » . These  estimates  have  the 

same  properties  of  symmetry  and  periodicity  as  F(CJ)  in 
Eq  (19).  This  estimate  is  asymptotically  unbiased  as  indi- 
cated in  this  theorem  from  Brillinger  (Ref  2i244). 


Theorem  6« 

Let  X(t),  t = 0,  +1,  . . . be  an  r vector-valued  series 
with  mean  function  ji  and  cross -variance  function  P (h) 
defined  in  Eq  (4).  Suppose  Jp(h)  is  absolutely  summable 
as  defined  in  Eq  (5).  Let  F(LJ)  be  given  by  Eqs  (32), 
(33)  and  (34)  and  if  2ws(T)/T  — • j as  I — • « then 

lira 

T — « E(F( U))  ■ F(  CJ ) for  -«  < U < - 

Once  we  have  an  estimate  of  F(Ly)  we  need  to  look  at  its 
distribution.  Again  Brillinger  (Ref  2i245)  gives  us  a theo- 

A 

rem  on  the  distribution  of  F(Ly). 


17 


Theorem  7 : 

Let  X(t),  t = 0,  +1,  . . . be  an  r vector-valued  series 

A 

satisfying  Eq  (5).  Let  F(Ly)  be  given  by  Eqs  (32), 

(33),  and  (34)  with  2tts(T)/T  — • L/  as  T « . Then 

A Ip 

F(L/)  is  asymptotically  distributed  as  (2m  + 1)"  ^ 

(2m  + 1,  F (U))  if  U £ O(modTr)  and  as  (2m)'^  Wr 

(2m,  F (U))  if  U = O(raodTt).  Also  F(LJj),  j = 1 J 

are  asymptotically  independent  if  Xj  +Xk  £ 0(mod  2rr)  for 
1 s j < k s J. 

Thus  our  current  estimators  are  "better”  (relatively  speaking) 
than  a non- smoothed  periodogram. 

In  Chapter  III,  we  will  discuss  how  we  tested  this  pro- 
cedure. At  this  time  we  will  look  at  a theoretical  calcu- 
lation of  a spectral  density  matrix  and  a confidence  interval 
on  the  estimated  spectral  density  matrix.  Our  vector  time 
series  are  three  first  order  autoregressive  (AR(1))  scalar  sta- 
tionary time  series  with  the  covariance  between  any  two  zero 
so  we  can  look  at  each  scalar  time  series  separately.  Fuller 
develops  the  theoretical  spectral  density  for  this  process 
(Ref  4 i 143-144).  First,  we  need  a theorem  about  the  spectral 
density  matrix  of  this  particular  process. 

Theorem  8 (Ref  4 1 140-141)  i 

Let  X(t)  be  a stationary  time  series  with  an  absolutely 

00 

suramable  covariance  function  and  let  {a.}  be 

3 j =-00 

absolutely  summable.  Then  the  spectral  density  of 
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Y(t)  = 2 a.X  . is 

jss-oo  J C-J 


fY(U)  = C 2-rr ) 2 fx(U)  fa(u)  f*((*>0 


where  fY(^)  is  the  spectral  density  of  X(t), 


fAiJ)  - (2TT)-1  2 a.  e"1^ 
a j— * J 


is  the  Fourier  transform  of  a.  , and 


f!(U)  * ( 2w ) " 1 2 a,  eiUj 


(35) 


(36) 


(37) 


is  the  complex  conjugate  of  the  Fourier  transform 
of  aj  . 

For  this  development  we  follow  Fuller  (Ref  4 i 143-144). 
A first  order  autoregressive  process  can  be  written  as 


oo 

X(t)  -2  O'5  e , 

j"0  C_J 


(38) 


By  Theorem  8 the  transform  of  the  weights  a4  * p-^  is  given 


by  Eq  (35) 


1 


j 


8a(L/)  = yr  2 DJ  e 
a ^ j=0 


& £ (pe-1U/)J 

j°0 
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-r-r-..  - 


lit  i - p exp( -i.cj ) 


and  its  complex  conjugate  is,  from  Eq  (37), 


g *(U)  - ^ (DJ  e1^') 


1 1 
7n  1 - q exp(iLy 


Hence,  also  by  Theorem  8 (Eq  (35))  we  have 


fx(D  - (2tr)2  fe(^)ga(^)  g*(Lu) 


- p exp(-tu', 


d\ L_ 

*1  - 2p  cosLj  + 


p exp(i^, 


(39) 


since  f(U)  is  the  spectral  density  of  the  uncorrelated 
sequence  (et)  and  equals  a^/2n  for  all  U, 

To  get  an  approximate  (1  - a)  significance  level  con- 
fidence interval  we  will  again  use  Fuller's  estimate.  Fuller 
summarizes  a long  discussion  (Ref  4 i 287-295)  into  the  fol- 
lowing result  (Ref  4i296)  which  we  will  use.  We  let  X(t)  be 
an  autoregressive  of  order  1 that  can  be  represented  as  an 
infinite  moving  average  of  the  fora 


X(t)  - E 


1 2 
where  ctj  ■ pJ  and  the  et  are  independent  (0,  a ) random 

variables  and  let  f(L/)  > 0.  Then,  for  ~ < U < tt(1  - , 

we  have  (f"*(Cj)  f(L/))  is  approximately  distributed  as  a 

chi-square  random  variable  divided  by  its  degrees  of 


freedom  v , where 


/m 
2 E 
I j**-m 


w2Cj) 


(40) 


and  where  f(U)  is  the  smoothed  periodogram,  the  average  of 
(2m  + 1)  periodograms.'  W(j)  is  a weight  such  that 


m 

E W(j)  = 1 
j*-m 


(41) 


W(j)  = W(-j) 


(42) 


We  can  construct  the  (1  - a)  level  confidence  interval  for 
f(U)  to  be 


v f (LJ 


s f(Ls')  z 


v f((*y; 


(43) 


v,  a/2 


v,  1 - (a/2) 


where  X * aj2  the  a/2  tabular  value  for  the  chi-square 
distribution  with  v degrees  of  freedom. 

This  estimator  is  for  the  diagonal  elements  of  the 
spectral  density  matrix.  For  the  cross  spectral  elements 
we  can  find  a confidence  interval  for  the  amplitude  of  the 
spectrum  (Ref  4il56,  314-317).  Let  the  cross  spectral 


estimate  be  represented  as 


* A .A 

f jk  " cjk  + 1 qjk 


(44) 


then  the  amplitude  of  f jk,  Ajk,  can  be  estimated  by 


a *2  *2 

Ajk  * c jk  + qjk 


(45) 


Fuller  does  not  state  a theorem  but  he  says  that  we  can 
assume  c^k  and  qjk  to  be  normally  distributed  (Ref  4 i 316-317), 
With  this  assumption  we  can  get  an  upper  and  lower  bound 
on  Ajk. 

The  upper  bound  can  be  calculated  as 


aVu) 


Ajk(~j)  + [(2m+l)‘1  fkk(U)  F2m(a)]* 


jj' 


■kk' 


4m ' 


(46) 


and 


A*jk(Ly)  - max  0,  A - [(2m+l)_1  f „(  L/)fkk(  U/)f£.(<i)]^ 


‘jk' 


’jj' 


(47) 


where 


W*'*  - 4k(>  - (^TT1 


A 9 


|f1k(^)l2 


c2k(L')  » q2k(^) 


^ fjj((*7)  fkk^^ 
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and  where  F^m  is  Snedecor's  F with  2 and  4ra  degrees  of 
freedom.  Hence,  combining  Eqs  (46)  and  (47)  we  have 

Ajk(U)  * s Ajk(L/) 


(48) 


Note  that  A , 


The  Test 


and 


This  completes  the  theory  we  need  to  get  into  the  pro- 
cedure we  will  be  using.  As  stated  earlier,  our  procedure 
is  based  on  the  work  of  P.  R.  Krishnaiah  and  F.  J.  Schuurmann. 
Since  we  will  be  accomplishing  two  tests,  a Beta  test  and  an 
F test,  we  will  be  discussing  two  test  statistics.  We  will 
look  at  the  test  statistics  first.  Kirshnaiah  and  Shuurmann 
state 

Let  Si  and  S2  be  distributed  independently  as 
central  complex  Wishart  matrices  with  m and  n degrees 
of  freedom,  respectively,  and  let  E(Si/m)  = E(S2/n)  * Ip, 
where  Ip  is  the  identity  matrix.  Then,  Si(Si  + S2)"* 
is  known  to  be  a central  complex  multivariate  beta 
matrix,  whereas  Sj  S2_*  is  known  to  be  a central  complex 
multivariate  F matrix  (Ref  7*2). 

Let  (X(t),  t - 0,  1,  . . . > and  CY(t),  t * 0,  1,  ...  } 
be  r-variate  Gaussian  time  series  with  E(X(t))  * 0 and 
E(Y(t))  = 0 for  all  t and  let  X(t)  and  Y(t)  be  covariance 
stationary  with  the  elements  of  their  respective  covariance 
matrices  absolutely  summable.  Let  F(L/)  be  the  spectral 
density  matrix  of  X(t)  multiplied  by  its  degrees  of  freedom 
and  G(U)  be  the  spectral  density  matrix  of  Y(t)  multiplied 
by  its  degrees  of  freedom. 


' 


PPIMM 


The  null  hypothesis,  H,  of  the  test  is  that  F(L/^) 

= G(  U£)  for  & = 1,  2,  . . . , q,  while  the  alternative 
hypothesis  is  that  F(L/£)  t G(U£)  for  i » 1,  2,  . . . , q. 
We  will  be  looking  at  two  different  tests,  a Beta  test  and 
an  F test.  We  will  talk  about  them  in  parallel  but  not  as 
one  over  the  second.  We  will  accept  H if  the  Beta  test 
statistic 

tr[F(  U£)(F(U£)  + &(  up)"1]  s aa  (49) 

where  tr  means  trace  and  a is  the  table  value  described 

a 

below.  Similarly  we  accept  H if  the  F test  statistic 

tr[F(  L/X)(G(  L/i))'1]  s ba  (50) 

where  b is  the  table  value  described  below.  We  do  not 
a 

require  that  both  tests  pass  to  accept  H.  We  only  require 
that  the  test  we  are  looking  at  pass. 

The  table  value  a^  is  the  upper  percentage  point  of 
the  distribution  of  the  trace  of  the  complex  multivariate 
beta  matrix  where  a indicates  the  probability  of  making  a 
type  1 error.  These  values  are  found  in  (Ref  7 i 12-63).  The 
table  value  is  the  upper  percentage  point  of  the  distri- 
bution of  the  trace  of  the  complex  multivariate  F matrix, 
with  a,  again,  indicating  the  probability  of  making  a type  1 
error.  These  values  are  also  found  in  (Ref  6«64-99).  The 
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a and  b are  chosen  such  that 
a cl 


5 P£ tr(F( U i ) (F( U + G^))'1}  s aa|H]  = (1  - a)  (51) 

X “*X 


n P[trCF( U t)  G (U-)_1>  s b|H]  = (1  - a)  (52) 

£=>1  * l CL 


Our  discussion  has  been  for  a one-tail  test.  If  you  want  to 
accomplish  a two-tail  test  just  replace  alpha  by  (a/2)  in 
Eqs  (51)  and  (52). 

In  this  chapter  we  have  looked  at  the  notation  and 
terminology  we  used  and  we  took  a brief  look  at  the  theory 
of  using  the  frequency  domain  to  analyze  time  series.  We 
then  discussed  the  procedure  and  the  test  statistics  we  used. 
In  the  next  chapter  we  will  discuss  the  simulations  we  did 
and  the  results  we  got  from  them. 


' yv  Kt>. . ; 'V  ^ • 
* v*  4 ft  wSj. . » y * ■ 


Ill . Monte  Carlo  Simulations 


This  chapter  discusses  the  Monte  Carlo  simulations 
accomplished  to  test  the  procedure  against  randomly  generated 
time  series.  As  stated  in  Chapter  II,  the  scalar  time  series 
are  first  order  autoregressive  stationary  time  series  of  the 
form 


Xr(t)  - e(t)  t=l 

Xr(t)  = PjXjXc-l)  + e(t)  t=2, . . . , T (53) 


where  T is  the  number  of  data  points.  The  e(t)  are  normal 
(0,1)  random  deviates  for  t=2,...,  T.  For  t»l,  e(t)  was 
adjusted  to  incorporate  the  effects  of  the  terms  between  -«» 
and  0 which  ensures  that  the  process  is  stationary.  The 
absolute  value  of  each  pr  was  less  than  one.  The  e(t) 
sequences  were  calculated  as  follows.  Using  the  International 
Mathematical  and  Statistical  Libraries,  Inc.  (LtSL)  routine 
GGUB,  we  obtained  a sequence  of  uniform  (0,1)  deviates 
(Ref  5iGGUB-l).  The  deviates  were  converted  to  normal  (0,1) 
deviates  by  using  the  Box -Mueller  technique.  Three  scalar 
time  series  were  generated  using  this  procedure  to  form  one 
X(t).  The  cross  covariance  between  X^(t)  and  Xm(t)  is  zero 
for  j j*m  soX(t)  is  a stationary  vector  time  series. 
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The  spectral  density  matrix  was  calculated  and  both 
test  statistics  were  calculated.  The  test  of  hypothesis 
used  was  a two-tail  test  at  four  different  alpha  values, 

0.2,  0.1,  0.05,  and  0.02.  In  the  first  two  simulations  we 
calculated  the  test  statistic  (using  the  notation  of  the 
procedure  discussion  in  Chapter  II)  as 

tr{£((*yi)[F(L/1)  + G(^)]"1}  = TRl  (54) 

and 

trtG^pCl^-jp  +C(^i)]'1}  = TR2  (55) 

for  the  Beta  test  and  as 

tr[F(  (^)(G(  W^))'1]  = TR3  (56) 

and 

tr[G(  LSt)(£(  L^))"1]  = TR4  (57) 


for  the  F test. 

For  both  tests  we  took  the  greater  of  TRl  and  TR2  and  the 
greater  of  TR3  and  TR4  and  tested  against  the  respective 

A A 

table  values.  F and  G were  written  using  Brillinger’s 
estimates,  Eqs  (32),  (33),  and  (34)  from  Chapter  II. 

In  all  simulations,  the  number  of  data  points,  T,  was 
200.  We  restricted  T to  be  even  so  we  did  not  use  Eq  (33). 

We  also  set  s(T)  in  Eq  (32)  to  vary  from  0 to  100  in  intervals 
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of  10.  This  allowed  us  to  look  at  eleven  frequencies 
between  zero  and  it,  inclusively.  The  frequencies  are 
tt/10  apart. 

The  analysis  can  be  accomplished  two  ways.  First, 
using  the  criteria  that  all  frequencies  pass  the  test  or 
using  a binomial  distribution.  A confidence  interval  was 
determined  from  a table  of  confidence  intervals  for  pro- 
portions. We  did  this  because  we  are  looking  at  failures  or 
successes,  a zero-one  test.  The  alpha  is  the  probability  of 
failure  for  simulation  I,  at  a specific  frequency. 

Before  we  look  at  the  results  of  the  simulations  and 
analyze  them,  a couple  points  need  to  be  emphasized.  The 
sample  size  of  each  simulation  is  small.  The  first  two  only 
consist  of  a hundred  runs  each,  when  they  should  be  at  least 
1,000  to  5,000  each.  The  third  simulation  was  done  with 
12  runs  which  seems  to  be  adequate  as  we  will  point  out 
later.  With  this  in  mind  we  can  still  make  inferences  about 
the  results,  though. 

The  runs  were  limited  because  the  program  took  a long 
time  to  run,  about  94  seconds  for  each  run.  This  length  of 
time  lowered  the  priority,  which  was  already  low  so  turn 
around  time  was  long.  A normal  sample  of  25  runs,  at  the 
minimum  had  an  overnight  turn  around,  though  the  usual  was 
two  to  three  days.  Programs  which  ran  only  one  run  had  an 
average  turn  around  time  of  three  hours.  A second  limiting 
factor  was  budget  limitations.  A final  point  we  wish  to 
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emphasize  is  thac  all  the  data  is  simulated.  We  were  unable 
to  receive  actual  data.  This  makes  the  analysis  aestheti- 
cally less  satisfying. 


1 


Keeping  the  limited  number  of  runs  in  mind  we  will  look 
at  the  first  simulation.  This  simulation  simulated  two  time 
series  with  equal  respective  rho  values.  The  values  used 
were  -0.7,  0.3,  and  0.8.  Figure  1 shows  the  theoretical 
spectral  density  matrix  for  these  two  time  series,  based  on 


Eq  (39)  with  = 1. 


1 


fxCU)  - T 

2n(l  + p*  - 2p  cosL,') 


In  testing  these  two  time  series  the  values  of  TRl  from 
Eq  (54)  and  TR2  from  (55)  should  be  1.5  for  all  frequencies. 
The  values  of  TR3  and  TR4  from  Eqs  (56)  and  (57)  should 
be  3.0  for  all  frequencies. 

The  results  of  this  simulation  are  interesting.  Table  I 
shows  the  results  at  each  of  the  alpha  values  for  the  Beta 
test.  Table  II  has  the  same  information  for  the  F test. 

Both  tables  show  that  the  number  of  failures  at  two  fre- 
quencies, zero  and  tt,  are  extremely  high.  We  cannot  explain 
this.  The  other  frequencies  include  their  respective  alpha 
within  their  95%  confidence  interval  (see  Ref  li220). 

Table  III  shows  the  number  of  runs  which  failed  exactly  at 
the  number  of  indicated  failures.  These  can  be  compared  with 
a binomial  distribution  (Ref  It  184)  and  the  comparison  shows 
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Figure  1.  Theoretical  Spectral  Density  Matrix,  Simulation  I 
(Selected  Frequencies) 


the  same  structure  even  though  the  table  values  do  not  match. 
A simulation  of  1,000  or  more  nans  should  show  the  values 
converging  to  the  table  values  for  the  binomial  distribution. 

There  are  two  ways  to  interpret  this  data.  From  our 
discussion  of  the  procedure  in  Chapter  II  we  can  require  all 
tests  to  pass.  The  alpha  for  each  test  must  be  small  to  get 
a larger  simultaneous  alpha  value.  For  example,  when  each 
run  is  tested  with  an  alpha  of  0.02  we  see  that  32  percent 
of  the  runs  failed  so  the  empirical  alpha  is  32  percent  for 
this  test. 
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Frequency 


Alpha 

0 

TT 

TO 

3tt 

T 

7tt 

TO 

4tt 

T 

9it 

TO 

IT 

0.2 

36 

16 

24 

17 

23 

14 

20 

14 

24 

17 

39 

0.1 

27 

9 

15 

7 

9 

9 

12 

9 

15 

10 

33 

0.05 

19 

6 

8 

2 

2 

7 

4 

2 

10 

5 

24 

0.02 

10 

3 

4 

• 0 

1 

2 

2 

0 

3 

2 

12 

Table  II 

Number  of  Failures 
F Test,  Simulation  I 


Frequency 


Alpha 

0 

TO 

TT 

3 

3it 

TO 

2tt 

T 

TT 

1 

3tt 

~T 

7tt 

TO 

4tt 

T 

9tt 

TO 

TT 

0.2 

78 

19 

26 

14 

17 

23 

20 

15 

25 

17 

77 

0.1 

62 

13 

14 

7 

8 

10 

10 

5 

15 

6 

65 

0.05 

50 

6 

9 

4 

3 

4 

8 

3 

9 

3 

59 

0.02 

39 

0 

3 

1 

0 

2 

4 

0 

2 

3 

44 
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An  alternative  method  is  to  use  the  Bernoulli  trial 


[] 

1 


( 

* 

I 
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concept  for  independent  trials  and  use  a decision  rule 
based  on  allowing  a certain  number  of  failures.  In  this 
method  we  set  the  simultaneous  alpha  based  on  the  cumulative 
binomial  distribution  function.  Table  III  and  the  binomial 
distribution  show  that  we  can  expect  some  frequencies  to 
fail  even  when  the  two  time  series  are  generated  by  the  same 
process.  Using  Table  III  and  the  cumulative  binomial  distri- 
bution table  (Ref  1«196),  we  determined  the  following 
decision  rules,  one  for  each  alpha.  At  a = 0.02  , if  the 
number  of  frequencies  that  fail  is  4 or  more,  then  the  test 
fails  and  the  null  hypothesis  is  rejected.  At  a = 0.05  , 
the  cut-off  is  3 or  more  frequencies.  At  a = 0.1  , the 
cut-off  is  also  3 or  more,  at  a = 0.2  , 4 or  more  frequencies. 
These  cut-off  values  give  a simultaneous  alpha  value  different 
than  the  one  being  considered  for  each  test.  The  value  for 
the  alpha  of  0.02  was  determined  from  Table  III.  For  the 
Beta  test  the  alpha  would  be  about  .01  and  for  the  F test 
it  would  be  .04.  For  the  other  cut-off  values  the  true 
alpha  would  be  0.02,  0.09,  and  0.16  for  0.05,  0.1  and  0.2 
respectively.  Table  IV  summarizes  the  cut-off  values  and 
the  upper  percentage  points  we  used  in  the  test. 

An  important  parameter  in  considering  cut-off  values 
is  the  number  of  frequencies  looked  at.  This  analysis  is 
for  eleven  frequencies.  A different  number  of  frequencies 
would  require  a different  cut-off  value.  The  analyst  should 
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Table  IV 

Test  Cut-Off  Values  and  Upper  Percentage 
Points  Used  With  Eqs  (49)  and  (50) 


Alpha 

Cut- 

off 

Value 

ao 

a o 

(raodn) 

aa 

^ # 0 
(modir) 

*>a 

U * 0 
(mod-n) 

t>a 

U $ o 
(mod-rr) 

0.20 

4 

1.715 

1.705 

5.516 

5.299 

0.10 

3 

1.77 

1.763 

6.173 

5.889 

0.05 

3 

1.823 

1.813 

6.83 

6.474 

0.02 

4 

1.88 

1.870 

7.72 

7.256 

use  a 

cumulative 

distribution 

table  and 

choose  the 

value  such 

that  the  probability  of  X or  more  failures  is  the  value  of 
the  alpha  level  he  requires.  An  alternative  procedure 
requiring  more  calculations  is  to  use  Bonferroni's  inequal- 
ity (Ref  3« 100). 

The  second  simulation  used  one  time  series  with  the 
same  parameters  as  the  first  simulation.  The  first  time 
series  has  rho  values  of  0.2,  -0.5,  and  -0.9.  It  was  felt 
that  these  rho  values  were  far  enough  apart  from  the  rho 
values  for  the  other  time  series  to  ensure  that  the  null 
hypothesis  would  be  rejected.  When  the  theoretical  spectral 
density  matrix  for  the  different  time  series  was  calculated 
(see  Figure  2)  and  the  test  statistics  were  calculated  using 
Eqs  (54),  (55),  (56),  and  (57),  a surprising  thing  was  noted. 
Some  of  the  frequencies  would  pass  the  test  of  hypothesis 
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Figure  2.  Theoretical  Spectral  Density  Matrix  for  First 
Time  Series,  Simulation  II  (Selected  Frequencies) 

as  being  equal.  Table  V shows  the  traces  calculated  by 
Eqs  (54)  and  (55)  for  the  Beta  test.  At  L/^  through 
depending  on  the  level  of  confidence,  we  expect  these  fre- 
quencies to  not  reject  the  null  hypothesis.  Similarly, 

Table  VI  shows  the  same  type  of  information  for  the  F test. 

The  simulation  agreed  with  this  theoretical  analysis. 
Table  VII  shows,  for  the  Beta  test,  the  number  of  failures 
for  each  of  the  alphas  we  looked  at  and  Table  VIII  shows  the 
same  information  for  the  F test.  In  Table  VII,  the  alpha 
characters  below  the  numbers  indicate  whether  or  not  that 


I Table  V 


Theoretical 

Traces  for 

Beta  Test,  Simulation  11 

! 

Ul 

TRl 

TR2 

a at  which  test  passes 

E 

E 

1 

1.0151 

1.9916 

Fail 

T< 
r i 

iM 

2 

1.0340 

1.9677 

Fail 

3 

1.1078 

1.8922 

Fail 

4 

1.2243 

1.7757 

0.05 

[ 

5 

1.3709 

1.6291 

0.20 

6 

1.5301 

1.4699 

0.20 

7 

1.6814 

1.3186 

0.2 

; 

8 

1.8030 

1.197 

0.05 

9 

1.8618 

1.1185 

0.02 

10 

1.9178 

1.0823 

Fail 

11 

1.9262 

1.0731 

Fail 

Table  VI 


Theoretical  Traces  for  F Test,  Simulation  II 


TR3 

TR4 

a at  which  test 

1 

4.7424 

95.0400 

Fail 

2 

4.548 

34.2282 

Fail 

3 

4.0596 

13.1404 

Fail 

4 

3.5201 

6.9400 

0.02 

5 

3.1627 

4.2634 

0.2 

6 

2.4260 

2.9484 

0.2 

7 

3.9651 

2.4260 

0.2 

8 

6.1311 

2.6625 

0.05 

Table  VII 


Table  VIII 

Number  of  Failures 
F Test,  Simulation  II 


Frequency 


TO 


100  100  100  98 


F F ‘ F 


5 TO 


100  100  100 


F F 


NOTE i F = Frequency  theoretically  Failed 
P = Frequency  theoretically  Passed 
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32 
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F 

F 
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83 

20 

5 

14 

76 
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F 

F 

F 

F 

P 

P 

P 

P 

F 

F 

F 
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100 

99 

73 

12 

2 

6 

63 

99 

100 

100 

F 

F 

F 

P 

P 

P 

P 

P 

F 

F 
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that  frequency  was  supposed  to  pass.  In  this  test  each  alpha 
had  at  least  one  frequency  where  the  number  of  failures  did 
not  have  the  alpha  value  in  its  95  percent  confidence  inter- 
val. Omega  of  3it/5  failed  more  times  than  expected,  except 
for  alpha  equal  to  0.05  the  number  of  failures  did  not 
include  the  alpha  level  in  a 99  percent  confidence  interval. 
Only  two  omega  values  passed  as  expected,  they  are  omega 
2it/5  and  n/2.  Again,  we  do  not  have  a reason  for  this,  how- 
ever, a simulation  of  a larger  number  of  runs  may  help  to 
bring  the  values  down. 

Table  VIII  shows  a similar  structure  for  the  F test 
results.  Only  omega  it/ 2 shows  values  that  include  the  alpha 
in  a 95  percent  or  99  percent  confidence  interval.  All  the 
other  frequencies  that  passed  do  not.  Again,  we  do  not  have 
a reason  for  this,  other  than  this  is  a result  of  the  small 
sample  size. 

Table  IX  shows  the  number  of  runs  which  had  the  indi- 
cated number  of  failures.  Using  the  binomial  distribution 
decision  criteria  developed  for  simulation  I (Table  IV),  we 
would  reject  the  null  hypothesis  that  these  two  time  series 
came  from  the  same  process.  The  only  problem  is  at  alpha 
equal  to  0.02  where  13  runs  passed  with  less  than  four  fre- 
quency failures. 

The  first  two  simulations  show  that  we  can  accept  or 
reject  the  null  hypothesis  for  simulated  time  series.  The 
problem  that  was  mentioned  during  the  discussion  of 
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simulation  I caused  us  to  question  the  estimator  for  iJ  » 0 
and  » n,  Eq  (33).  To  look  at  the  estimators  we  accom- 
plished simulation  III  to  calculate  the  spectral  density 
matrix  of  a time  series.  The  rho  values  we  chose  were  the 
same  as  the  ones  for  simulation  I which  were  -0.7,  0.3,  and 
0.8.  After  averaging  12  time  series,  the  difference  between 
the  average  of  10  and  12  time  series  was  only  in  the  third 
decimal  place,  so  we  can  assume  the  process  has  settled 
down  and  that  a sample  size  of  12  is  adequate  for  this 
analysis. 

-14 

Terms  on  the  order  of  magnitude  of  10  or  less  have 
been  set  to  zero  because  10“^  is  the  round-off  error  for  the 
CDC  6600  computer  the  simulation  was  run  on.  A 95  percent 
confidence  interval  using  Eq  (43)  for  the  diagonal  elements 
and  Eq  (48)  for  the  off  diagonal  elements.  Figure  3 shows 
the  spectral  density  matrix  for  the  three  values  of  omega 
and  Figure  4 shows  the  95  percent  confidence  interval  for 
these  values.  The  values  in  Figure  1 are  included  in  the  95 
percent  confidence  intervals  for  the  estimates. 

Note  that  the  actual  values  for  omega  equal  to  zero 
and  tt  are  within  the  95  percent  confidence  interval  for  the 
estimates.  This,  then,  cannot  explain  the  bad  results  we  had 
at  those  frequencies. 

Hence,  we  are  reasonably  sure  that  our  estimates  are 
estimating  the  actual  spectral  density  matrix.  We  can  also 
conclude  that  the  results  of  simulations  I and  II  are  feasi- 
ble, keeping  in  mind  the  small  sample  size. 
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Figure  3.  Spectral  Density  Matrix,  Simulation  III 
(Selected  Frequencies) 
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: spectrum,  while  off  diagram  elements  are  for  the  amplitude 
of  the  cross  spectrum.  • 


Figure  4.  95  Percent  Confidence  Intervals,  Simulation  III 
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IV.  Conclusions  and  Recommendations 


We  took  P.  R.  Krishnaiah  and  F.  J.  Schuurmann ' s theo- 
retical work  and  showed  the  development  of  the  theory  and 
applied  it  to  some  simulations.  We  cannot  make  definitive 
conclusions  based  on  the  simulations  because  the  sample  size 
was  too  small.  We  did  see  that  some  problems  exist  at  the 
frequencies  zero  and  it  which  cannot  be  explained  by  theory. 

A larger  sample  size  is  needed  to  make  quantitative  judge- 
ments on  that  aspect. 

Based  on  the  development  of  the  theory  there  is  no 
reason  that  this  technique  will  not  work  for  a r- variate 
vector  time  series.  We  did  not  restrict  the  theory  to  the 
three  variable  vector-valued  time  series  that  we  did  our 
simulations  on.  In  the  same  vein,  there  is  no  reason  that 
this  technique  will  not  work  for  processes  other  than  the 
first  order  autoregressive  process  we  simulated. 

The  computer  program  we  used  is  not  attached  to  this 
thesis  because  there  are  several  Fast  Fourier  Transformation 
programs  available  that  can  be  used  to  calculate  the  spec- 
tral density  matrix.  When  applying  this  technique  to  AFTECs 
problem  or  any  similar  problem,  analysts  can  use  the  canned 
programs  to  set  up  their  spectral  density  matrix  and  easily 
multiply  them  by  the  degrees  of  freedom  and  calculate  the 
test  statistics,  Eqs  (54)  through  (57). 


45 


An  important  consideration  that  AFTEC  or  other  users  of 
this  technique  should  be  aware  of  is  the  selection  of  the 
number  of  frequencies  tested.  They  should  select  enough 
frequencies  far  enough  apart  so  that  the  probability  that 
all  frequencies  pass  is  small.  This  causes  the  probability 
of  a type  II  error  to  be  small.  The  analyst  controls  the 
probability  of  a type  I error.  The  frequencies  looked  at 
should  be  harmonics  or  every  other  harmonic  or  any  other 
consistent  scheme.  They  have  to  balance  their  desire  for 
accuracy  with  the  cost  of  examining  at  a greater  number  of 
frequencies.  It  is  a common  problem  in  testing  to  have  to 
balance  the  probability  of  a type  I error  with  the  probability 
of  a type  II  error. 

Another  area  that  they  need  to  understand  is  model 
building  in  time  series.  They  should  be  able  to  take  the 
data  and  see  what  kind  of  process  and  what  the  parameters 
of  that  process  are  using  least  sums  of  squares  or  maximum 
liklihood  estimators.  This  is  especially  important  when 
they  get  data  that  rejects  at  several  frequencies  while 
passing  at  several  frequencies  as  our  simulation  II  did. 

There  are  some  areas  where  further  work  is  needed,  using 
this  thesis  as  the  starting  point.  The  first  is  the  problem 
with  frequencies  zero  and  tr.  An  investigation  into  why  these 
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A comparison  of  Tables  II  and  VIII  with  Tables  I and  VII 
and  Table  III  with  Table  IX,  indicates  that  the  F test  is 
more  sensitive  than  the  Beta  test.  Again,  our  small  sample 
size  precludes  us  from  making  a definitive  statement  and  it 
should  be  investigated.  The  problem  could  be  in  the  com- 
puter rounding  on  cos  and  sin  for  these  frequencies. 

AFTEC  and  other  users  need  to  consider  the  two  alterna- 
tive decision  rules  we  looked  ati 
(i)  all  pass 

(ii)  Binomial  distribution,  m or  more  out  of  n have 
to  fail  to  reject. 

It  would  seem  that  (i)  would  have  a smaller  probability  of 
type  II  error.  Further  investigation  of  simultaneous  tests 
to  see  what  happens  to  the  probability  of  type  II  error  would 
be  fruitful.  The  analysts  will  have  to  select  the  decision 
rule  they  are  most  comfortable  with  and  build  the  test 
around  it. 
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